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O ' Abstract 

m 

Compressed sensing is a novel technique where one can recover sparse signals from the undersampled 
measurements. In this correspondence, a K x N measurement matrix for compressed sensing is determin- 
istically constructed via additive character sequences. The Weil bound is then used to show that the matrix 
has asymptotically optimal coherence for N = K 2 , and to present a sufficient condition on the sparsity 
level for unique sparse recovery. Also, the restricted isometry property (RIP) is statistically studied for the 
deterministic matrix. Using additive character sequences with small alphabets, the compressed sensing 
matrix can be efficiently implemented by linear feedback shift registers. Numerical results show that the 

O ' 

deterministic compressed sensing matrix guarantees reliable matching pursuit recovery performance for 



o 
o 



both noiseless and noisy measurements. 
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$H ' Additive characters, compressed sensing, restricted isometry property, sequences, Weil bound. 



I. Introduction 

Compressed sensing (or compressive sampling) is a novel and emerging technology with a variety 
of applications in imaging, data compression, and communications. In compressed sensing, one can 
recover sparse signals of high dimension from few measurements that were believed to be incomplete. 
Mathematically, measuring an A^-dimensional signal x G M. N with a K x N measurement matrix A 
produces a if-dimensional vector y = Ax in compressed sensing, where K < N. In recovering x, it 
seems impossible to solve K linear equations with indeterminates by basic linear algebra. However, 
imposing an additional requirement that x is s-sparse or the number of nonzero entries in x is at most 
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s, one can recover x exactly with high probability by solving the l\ -minimization problem, which is 
computationally tractable. 

Many research activities have been triggered on theory and practice of compressed sensing since 
Donoho [1], and Candes, Romberg, and Tao 0(31 published their marvelous theoretical works. The 
efforts revealed that a measurement matrix A plays a crucial role in recovery of s-sparse signals. In 
particular, Candes and Tao (3) presented the restricted isometry property (RIP), a sufficient condition 
for the matrix to guarantee sparse recovery. A random matrix has been widely studied for the RIP, 
where the entries are generated by a probability distribution such as the Gaussian or Bernoulli process, 
or from randomly chosen partial Fourier ensembles. Although a random matrix has many theoretical 
benefits (H, it has the drawbacks of high complexity, large storage, and low efficiency in its practical 
implementation (51. As an alternative, we may consider a deterministic matrix, where well known codes 
and sequences have been employed for the construction, e.g., chirp sequences 0, Kerdock and Delsarte- 
Goethals codes Q, second order Reed-Muller codes JH, and dual BCH codes @- Other techniques for 
deterministic construction, based on finite fields, representations, and cyclic difference sets, can also be 
found in ifTOTl — lfT~2Tl . respectively. Although it is difficult to check the RIP and the theoretical recovery 
bounds are worse than that of a random matrix JH, the deterministic matrices guarantee reliable recovery 
performance in a statistical sense, allowing low cost implementation. 

To enjoy the benefits of deterministic construction, this correspondence presents how to construct a 
K x N measurement matrix for compressed sensing via additive character sequences. We construct the 
matrix by employing additive character sequences with small alphabets as its column vectors. The Weil 
bound |[T3l is then used to show that the matrix has asymptotically optimal coherence for N = K 2 , 
and to present a sufficient condition on the sparsity level for unique sparse recovery. The RIP of the 
matrix is also analyzed through the eigenvalue statistics of the Gram matrices as in |fj). Using additive 
character sequences with small alphabets, the matrix can be efficiently implemented by linear feedback 
shift registers. Through numerical experiments, we observe that the deterministic compressed sensing 
matrix guarantees reliable and noise-resilient matching pursuit recovery performance for sparse signals. 

II. Preliminaries 
The following notations will be used throughout this correspondence. 

— Up = e • p is a primitive p-th root of unity, where j = y— 1. 

— ¥ q = GF(q) is the finite field with q elements and F* denotes the multiplicative group of ¥ q . 

— ¥ q [x] is the polynomial ring over ¥ q , where each coefficient of f(x) S ¥ q [x] is an element of ¥ q . 
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— Let p be prime, and n and m be positive integers with m\n. A trace function is a linear mapping 
from F p ™ onto F p ™ denned by 

n/m—l 
i=0 

where the addition is computed modulo p. 

A. Additive characters 

Let p be prime and m a positive integer. We define an additive character lfl4l of ¥ p m as 

xW=exp j ^ , x G F p m (1) 



P 

where \{ x + 2/) — x( x )x(?/) f° r x,y G ¥ p m. The Weil bound 1131 gives an upper bound on the magnitude 
of additive character sums. We introduce the bound as described in lfl4l . 

Proposition 1: lfl4l Let f(x) G F pm [x] be a polynomial of degree r > 1 with gcd(r,p m ) = 1. Let x 
be the additive character of F p ™ defined in (Q]). Then, 



< (r - 1) VP™- (2) 



From (|2]), X]a;eF m = is obvious. In the Weil bound, the condition of gcd(r, p m ) = 1 can be 
replaced by the weaker one that the polynomial / should not be of the form h{x) p + h(x) + e for any 
polynomial h(x) G F p m[x] and any e G F pm |[T4l . 

B. Restricted isometry property 

The restricted isometry property (RIP) El presents a sufficient condition for a measurement matrix A 
to guarantee unique sparse recovery. 

Definition 1: The restricted isometry constant 5 S of a K x A" matrix A is defined as the smallest 
number such that 

(l-«5 s )||x||2<||Ax|| / 2 2 <(l + ( 5 s )||x||2 

holds for all s-sparse vectors x G M. N , where \\~x\\f 2 = ^2n=o \ x n\ 2 with x = (xo, • • • ,xn-i) G R N . 

We say that A obeys the RIP of order s if 5 S is reasonably small, not close to 1. In fact, the RIP requires 
that all subsets of s columns taken from the measurement matrix should be nearly orthogonal lfl31 . 
Indeed, Candes |[T6l asserted that if 62s < 1, a unique s-sparse solution is guaranteed by /o-minimization, 
which is however a hard combinatorial problem. 
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A tractable approach for sparse recovery is to solve the Zi-minimization |2|, i.e., to find a solution 
of minx gK N Hxllzj subject to Ax = y, where Hx]^ = X^o* \xi\. In addition, greedy algorithms iTTTl 
have been also proposed for sparse signal recovery, including matching pursuit (MP) |[T8l , orthogonal 
matching pursuit (OMP) |[T9l , and CoSaMP ll20l . In particular, if a measurement matrix is deterministic, 
we may exploit its structure to develop a reconstruction algorithm for sparse signal recovery ll61[8l l[T2l . 
providing fast processing and low complexity. 

C. Coherence and redundancy 

In compressed sensing, a K x N deterministic matrix A is associated with two geometric quantities, 
coherence and redundancy |[2ll . The coherence \i is defined by 

I FT I 

a = max a, • a m 

0<l^m<N-l 1 1 

where a* denotes a column vector of A with ||a*||j 2 = 1, and a^ is its conjugate transpose. In fact, the 
coherence is a measure of mutual orthogonality among the columns, and the small coherence is desired 
for good sparse recovery |@). In general, the coherence is lower bounded by 



N -K 



K(N - 1) 
which is called the Welch bound |[22l . 

The redundancy, on the other hand, is defined as p = ||A|| 2 , where || • || denotes the spectral norm of 
A, or the largest singular value of A. We have p > N/K, where the equality holds if and only if A is 
a tight frame. For unique sparse recovery, it is desired that A should be a tight frame with the smallest 
redundancy |[23l . 



III. Compressed Sensing Matrices from Additive Character Sequences 
A. Construction 

Construction 1: Let p be an odd prime, and m and h be positive integers where h > 1. Let K = p m 
and iV = K h = p mh . Set a column index to n = Yli=i u %K l ~ l where Ui = \_ K 7-i \ mod K. For each 
i, 1 < i < h, let 

0, if Ui = 0, 

(3) 

a u i -l ) Hl< Ui <p m -l 
where 6j £ F p ™ and a is a primitive element in F p ™ . For a positive integer d > h, let ri , T2 , • • • , be 
h distinct integers such that 1 = n < < • • • < = d and gcd(rj,p m ) = 1 for each i, 1 < i < h. 
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Then, we construct a K x N compressed sensing matrix A where each entry is given by 



1 

1 Trr(Et 1 ^°"' ( ' c - 1) 

Tk^p 



if k = 0, 

if 1< fc < A" - 1 



(4) 



where < n < N - 1. 



In Construction [TJ if p = 2 and r^'s are successive odd integers, then each column vector of A is 
equivalent to a codeword of the dual of the extended binary BCH code, which has been studied in @ for 
compressed sensing. In |[24l . Xu also presented a similar construction by defining an additive character 
with large alphabet as x( x ) = e j27ra: / p where p = K, which is a generalization of chirp sensing codes 0. 

Using the Weil bound on additive character sums, we determine the coherence of A. 

Theorem 1: In the K x N matrix A from Construction [TJ the coherence is given by 



max 



|d ni ct "-2 1 



d-l 



(5) 



0< ni ^n 2 <N~l 1 1 1 y/K 

where if d = 2, the coherence is asymptotically optimal, achieving the equality of the Welch bound. 

Proof. Consider the column indices of n\ = Ya=i UiK % ~ 1 and ra 2 = Yli=i where ni / n 2 . 

According to ©, let fej = or a Ui_1 , and = or a u * _ , respectively. Similarly, from (01), let x = 
if A; = 0, or x = a k ~ l otherwise. Then, the inner product of a pair of columns in A is given by 



I a.™ . * a^ 



1 

K 



E w p 



■&r(EU(6i-6«)* r 



i 

a" 



E x E(^ - w^ 4 



j-t?,, 



(6) 



In ([6]), if ni / n 2 , then f(x) = Yli=i(K ~ h) xri is a nonzero polynomial in Fpm[z], as there exists at 
least a pair of where 6j 7^ 6^. Since gcd(rj,p m ) = 1 for any n, the Weil bound in Proposition Q] 

produces 

|H , (d-l)VK _d-l 
|a ni -a n2 |< - __ 

from which the coherence in ([5]l is immediate. For given K and N, the equality of the Welch bound 

-7=. Therefore, the coherence asymptotically achieves the 

□ 



is computed by yj K N {N * 1} = y k^-k 
equality of the Welch bound if d = 2. 



Theorem 2: In the matrix A from Construction [Q unique s-sparse signal recovery is guaranteed by 
l\ -minimization or greedy algorithms if 

Ik 



1 

s < - , 

2 \ d- 1 



+ 1 



(7) 
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Proof. The upper bound on the sparsity level is straightforward from the coherence /i = ^= and the 
Tropp's sufficient condition ifTTl of s < \{p~ l + 1) for unique sparse recovery. 



□ 



Remark 1: In Construction [j] if d = h, then log (^) = (h - 1) log K = (d - 1) log K with N = K h . 
Thus, -py = j^7%7Fi and from (0, we have the sparsity bound of 



log(AV^) 



S < 



1 / \f~K log K 



+ 1 



2 Uog(JV/A") 

for unique sparse recovery. Therefore, we obtain the sparsity bound of s < CVK log K/log(N/K) from 
Construction [Q which is known to be the largest for deterministic construction ifTOll . 

Theorem 3: In Construction [TJ A is a tight frame with redundancy p = N/ K. 

Proof. In A, consider a set of K column indices of n = Yli=i UiK l ~ l where u\ is varying for < 
u\ < K — 1, while U2,u% : • • • , and Uh are fixed. Accordingly, note from ® that bi runs through F p ™, 
while 62 , bs, • • • , and bh axe, fixed in F p ™. Then, the set of columns forms a K x K submatrix at, where 
t = U2 + U3K + • • • + UhK h ~ 2 , < t < K h ~ x — 1. In fact, a t is a set of K orthonormal bases and A 



is a concatenation of the K 



h-l 



sets for < t < K 



h-l 



Let w/^ and w^,, be a pair of distinct row vectors in at, where Q < k\ ^ k2 < K — 1. For i = 1 and 
2, let Xi = if ki = 0, and Xi = a kz ~ l if ki > 1. Then, the inner product of w/^ and Wfc 2 is given by 



1 

A" 



E 



Trr(Eti^« 1 -^ 1 )) 



0J 



J] X(K 1 -^ 1 )6 1 ) 



where xi 7^ ^2- Finally, the mutual orthogonality of a pair of distinct rows in A is obtained if the 
submatrix at is concatenated for all t. Similar to the proof of Lemma 6 in (51, A is a tight frame with 
redundancy p = N/K from the mutual orthogonality and |afc jn | = -^=. □ 

Theorem Q] proved that the compressed sensing matrix A in Construction Q] has optimal coherence if 
d = 2. Also, Theorem [3] showed that A is a tight frame with optimal redundancy p = N/ K for any 
choice of d. Taking d = h = 2, and r\ = 1 and r2 = 2, we consider a special matrix of Construction Q] 



Construction 1.1: Let p be an odd prime and m be a positive integer. Let K = p m and N = K 2 



P 



2m 



Set a column index to n = u\ + U2K where u\ = n (mod K) and U2 = \_^\ ■ For i = 1 and 2, define 
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Fig. 1. Condition number statistics of additive character and Gaussian random sensing matrices. (K = 81, N = 6561, p = 3) 



hi by (©. Then, we construct a K x 7Y compressed sensing matrix A where each entry is given by 



where < n < N - 1. 

From Theorems [T] [2 and [3l the following properties of A in Construction 11.11 are straightforward. 

Corollary 1: The coherence of A in Construction 11-11 is fi = -^=. Then, the matrix A guarantees 
unique s-sparse signal recovery by l\ -minimization or greedy algorithms if s < \ ( \/K + 1 ) . Also, A is 



2 

a tight frame with redundancy K. With the optimal coherence and redundancy, the K x K 2 compressed 
sensing matrix A is an ideal deterministic construction for unique sparse recovery |[23l . 

B. RIP analysis 

In Construction 11.11 we choose p = 3 and m = 4, which produces the compressed sensing matrix A 
with K = 81 and N = 6561. For statistical analysis, we measured the condition number, or the ratio of 
the largest singular value of a matrix to the smallest. Figure Q] displays the means and standard deviations 
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of the condition numbers of A s and G s , respectively, where A s is a submatrix of s columns randomly 
chosen from the additive character sensing matrix A, while G s is a K x s Gaussian random matrix 
with K = 81. The statistics were measured over total 10, 000 condition numbers, where each matrix is 
newly chosen at each instance. Each entry of the Gaussian matrix G s is independently sampled from 
the Gaussian distribution of zero mean and variance and each column vector is then normalized such 
that it has unit /2-norm. 

Note that the singular values of A s are the square roots of the eigenvalues of the Gram matrix A s . 
Since the RIP requires that the Gram matrix should have all the eigenvalues in an interval [1 — 5 S , 1 + 5 S ] 
with reasonably small 5 S 0J, the condition numbers should be as small as possible for unique sparse 
recovery. From this point of view, we observe from Figure Q] that our additive character sensing matrix 
shows better statistics of condition numbers than the Gaussian matrix. This convinces us that A in 
Construction 11.11 is suitable for compressed sensing in a statistical sense. 

C. Implementation 

In Construction [T] excluding the first element of -7= , each column of A is a pseudo-random sequence 
where each element is represented as a combination of trace functions which is modulated by an 
exponential function. Precisely, the pseudo-random sequence is Cb lt b 2 ,- ,b h (k) = J2i=i (bia r,h ) , k = 
0, 1, • • • ,p m — 2. Since a sequence of a trace function is generated by a linear feedback shift register 
(LFSR) |25l , c% {,„ ... 6 h (k) is generated by a combination of h different LFSRs where each LFSR has at 
most m registers. Generating each column with LFSRs, we can efficiently implement the sensing matrix 
A with low complexity. For more details on a trace function and its LFSR implementation, see |[25l . 

As an example, Figure [2] illustrates an LFSR implementation generating a sequence Cb u b 2 {k) = 
Tr? 1 (ha k ) + Tr^ (b 2 a 2k ) , k = 0, 1, • • • ,p m - 2, for the matrix A in Construction [TT1 In the example, 
we take p = 3 and m = 4, and define the finite field F34 by a primitive polynomial g\ [x] = x 4 + x 3 + 2 
that has the roots of a primitive element a and its conjugates. Then, g\{x) specifies a feedback connection 
of the upper LFSR that generates a ternary sequence of Ti\{bia k ). The lower LFSR, on the other hand, 
has a feedback connection specified by g 2 (x) = x 4 + 2x s + x 2 + 1 that has the roots of a 2 and its 
conjugates, generating a ternary sequence of Trf (&2« 2fc )- In the structure, note that each register can take 
a value of 0, 1, or 2, and the addition and multiplication are computed modulo 3. Finally, the sequences 
of c& li 6 2 (fc) are generated by the LFSR structure for every possible pairs of initial states corresponding 
to &i, 62 G F34. As there exist total 3 s initial state pairs, the corresponding sequences Cb u b 2 {k) make 
N = 3 8 columns for A. 
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IV. Recovery performance 

A. Recovery from noiseless data 

Figure [3] shows numerical results of successful recovery rates of s-sparse signals measured by a 81 x 
6561 compressed sensing matrix A in Construction II. 1[ where total 2000 sample vectors were tested for 
each sparsity level. For comparison, the figure also shows the rates for randomly chosen partial Fourier 
matrices of the same dimension, where we chose a new matrix at each instance of an s-sparse signal, in 
order to obtain the average rate. Each nonzero entry of an s-sparse signal x is independently sampled 
from the normal distribution with zero mean and variance 1, where its position is chosen uniformly at 
random. For both sensing matrices, the matching pursuit recovery with maximum iteration of 100 was 
applied for the reconstruction of sparse signals. A success is declared in the reconstruction if the squared 
error is reasonably small for the estimate x, i.e., ||x — < 10 -4 . 

In the experiment, we observed that if s < 4, more than 99% of s-sparse signals are successfully 
recovered for the matrix A, which verifies the sufficient condition in Corollary [TJ Furthermore, the figure 
reveals that our sensing matrix has fairly good recovery performance as the sparsity level increases. 
For instance, more than 95% successful recovery rates are observed for s < 7, which implies that the 
sufficient condition is a bit pessimistic. The sensing matrix also shows better recovery performance than 
randomly chosen partial Fourier matrices with matching pursuit recovery. We made a similar observation 
from additive character and partial Fourier compressed sensing matrices with K = 49 and N = 2401. 



10 




Fig. 3. Successful recovery rates for additive character and partial Fourier sensing matrices, where K = 81 and N = 6561. 

In Figure |3j each element of A takes |, ', or ' , while the partial Fourier matrix has the 
element of \e^~ where N = 6561. Therefore, the compressed sensing matrix from additive character 
sequences with small alphabets has low implementation complexity as well as good recovery performance. 

B. Recovery from noisy data 

In practice, a measured signal y contains measurement noise, i.e., y = Ax + z, where z G 
denotes a iC-dimensional complex vector of noise. Thus, a compressed sensing matrix must be robust 
to measurement noise by providing stable and noise resilient recovery. Figure [4] displays the matching 
pursuit recovery performance of our sensing matrix in the presence of noise. The experiment parameters 
and the sparse signal generation are identical to those of noiseless case. In the figure, x is s-spare for 

||Ax|| 2 

s = 1,2,3, and signal-to-noise ratio (SNR) is defined by SNR = Ka2 ' 2 , where each element of z 
is an independent and identically distributed (i.i.d.) complex Gaussian random process with zero mean 
and variance a\. In noisy recovery, a success is declared if ||x — x||^ < 10~ 2 after 100 iterations. 
From Figure [4] we observe that the recovery performance is stable and robust against noise corruption 
at sufficiently high SNR, which is similar to that of randomly chosen partial Fourier matrices. 



1 1 




SNR (dB) 

Fig. 4. Successful recovery rates for additive character and partial Fourier sensing matrices in the presence of noise, where 
K = 81 and N = 6561. 

V. Conclusion 

This correspondence has presented how to deterministically construct a K x N measurement matrix 
for compressed sensing via additive character sequences. We presented a sufficient condition on the 
sparsity level of the matrix for unique sparse recovery. We also showed that the deterministic matrix with 
N = K 2 is ideal, achieving the optimal coherence and redundancy. Furthermore, the RIP of the matrix 
has been statistically analyzed, where we observed that it has better eigenvalue statistics than Gaussian 
random matrices. The compressed sensing matrix from additive character sequences can be efficiently 
implemented using LFSR structure. Through numerical experiments, the matching pursuit recovery of 
sparse signals showed reliable and noise resilient performance for the compressed sensing matrix. 
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